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ABSTRACT 

Graded nilpotent Lie groups, or Carnot Groups are to subRiemannian ge- 
ometry as Euclidean spaces are to Riemannian geometry. They are the metric 
tangent cones for this geometry. Hoping that the analogy between subRieman- 
nian and Riemannian geometry is a strong one, one might conjecture that the 
subRiemannian geodesic flow on any Carnot group is completely integrable. We 
prove this conjecture is false by showing that that the subRiemannian geodesic 
flow is not algebraically completely integrable in the case of the group whose Lie 
algebra A/"- consists of 4 by 4 nilpotent triangular matrices. We use this to prove 
that the centralizer for the corresponding quadratic "quantum" Hamiltonian H 
in the universal enveloping algebra of N- is "as small as possible" . 

1 Introduction 

Geometry would be in a sorry state if the Euclidean geodesic flows were not 
completely integrable - in other words, if we did not have explicit algebraic 
descriptions of straight lines in Euclidean space. Riemannian geometry, being 
infinitesimally Euclidean, makes frequent use of these explicit descriptions. For 
example the Euclidean lines play a role in the exponential map and in Jacobi 
flelds. 

SubRiemannian geometries, also called Carnot-Caratheodory geometries, are 
not infinitesimally Euclidean. Rather they are, at typical points, infinitesimally 
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modelled by Carnot groups. We will review these geometries and groups, and 
the relation between them momentarily. The point of this note is to show 
that the Carnot geodesic flows need not be integrable. We do this by 
giving an example of a 'chaotic' Carnot geodesic flow. 

A subRiemannian geometry consists of a nonintegrable subbundle (distri- 
bution) V of the tangent bundle T of a manifold, together with a fiber-inner 
product on this bundle. These geometries arise, among other places, as the 
limits of Riemannian geometries. In such a limit we penalize curves for mov- 
ing transverse to V so that in the limit any curve not tangent to V has infinite 
length. The distance between two points in a subRiemannian manifold is defined 
as in Riemannian geometry: it is the infimum of the lengths of all absolutely 
continuous paths connecting the two points. A theorem attributed to Chow 
asserts that if V generates T under repeated Lie brackets, and if the manifold 
is connected then this distance function is everywhere finite. Equivalently, and 
two points can be connected by a curve tangent to V. In this manner, every 
subRiemannian manifold becomes a metric space. 

By a Carnot group we mean a simply connected Lie group G whose Lie 
algebra Q is finite-dimensional, nilpotent, and graded with the degree 1 part 
generating the algebra and endowed with an inner product. Specifically; 

g = Vi(BV2(s...Vr 

as a vector space. The Lie bracket satisfies 

[Vi,Vj]cVi+j 

where 14 = for s > r. Also: 

K+i = [VuVi] 

and Vi is an inner-product space. Wc may think oi V = Vi as a left-invariant 
distribution on the group G. Its inner product then gives G a subRiemannian 

geometry. 

Given a distribution V cT,we can, at typical points q of Q, obtain a graded 
nilpotent Lie algebra. In order to do this, let V also stand for the the sheaf of 
smooth vector fields whose values lie in V. Form 

y2 = [v, V] 

where the brackets denote Lie brackets of vector fields. (Exercise: Show that, 
as sheaves: c V^^^.) We assume that V is bracket generating, which means 
that in a neighborhood of any point there is an integer r such that y = T. 
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(This is the hypothesis of Chow's theorem.) A point q of the manifold is caUed 
REGULAR if the sheaves correspond to vector bundles near q. This means 
that if we evaluate each of these spaces of vector fields at a point q E Q thus 
obtaining a flag of subspaces: 

C C C . . . C V^iq) = T,Q (1) 

then the integers dim{V^q)) are constant in some neighborhood of q. For 
a generic distribution, generic points are regular. Associate to the filtration 
V C C . . . CT of sheaves its corresponding graded object 

Gr{V, T)g^V®V2®...Vr...®Vr 

where Vj = /V^~^ is the quotient sheaf. Because the Lie bracket of vec- 
tor fields X,Y satisfies [X,fY] = f[X,Y] mod X,Y where / is a function, it 
induces bilinear maps : V, 14 ^j+k- Putting these maps together de- 
fines, at any regular point, a Lie algebra structure on Grq = Gr(V,T){q) = 
Viq) © V2iq) © . . . Vr{q). The subspace Vg = Vi{q) of Gr{V,T)g is the original 
k-plane field at that point, and Lie-generates Gvq. It follows that Q = Gr{V, T)g 
is the Lie algebra of a Carnot group. If the distribution V comes with an in- 
ner product, then this generating subspace inherits it. Consequently G comes 
with a canonical left-invariant subRiemannian structure. This G is called the 
NILPOTENTIZATION of the subRicmannian structure at the regular point q. 

Gromov, using the idea of the Hausdorff limits of a family of metric spaces, 
showed how to defi ne a "tangent space" to any point of any metric space. (See 



Gromov et al | Gr2 |.) This limiting space, called the metric tangent cone, only 
exists for 'nice' metric spaces. For a Riemannian manifold it is the usual tangent 
space with its Euclidean structure. The metric tangent cone also exists for 
subRiemannian metrics. A theorem of of Mitchell H asserts that at a regular 



point it is the nilpotentization. We urge the reader to consult Gromov |Gr2|, 



[ |Grl| and Bellaichc [§cll| 



The nilpotentization is the closest object we have in subRiemannian geome- 
try to the Euclidean tangent space in Riemannian geometry. The match is not 
perfect but it is the best thing we have. 



1.1 The geodesic flow 

The data of a subRiemannian geometry can be re-encoded as a fiber-quadratic 
non- negative form H : T*Q ^ M on the cotangent bundle T*Q. The kernel 
{H = 0} of iJ is the annihilator of the distribution V. Upon polarization H 
becomes a bilinear non- negative form, and thus a symmetric map g : T*Q 
TQ. The image of this map is V and the map satisfive {g{p), v)q = p{v) for any 
p € T'^*q, V € Vq, q G Q, where (•, •) is the inner product on V. The Hamiltonian 
flow associated to H generates curves in the cotangent bundle whose projections 
to Q are subRiemannian geodesies. By a subRiemannian geodesic we mean a 



3 



curve in Q with the property that the length of any sufficiently short subarc of 
the curve equals the subRiemannian distance between the endpoints of this arc. 
Such curves are necessarily necessarily tangent to V. 

To write down H explicitly, pick any local orthonormal frame {^i, . . . , Xk} 
for the distribution V. Now the Xi can be viewed as fiber-linear functions on the 
cotangent bundle T* and hence their squares Xf are fiber-quadratic functions. 
The Haniiltonian is: 

H=^{Xf + Xl + ...Xl). 

REMARK. Unlike Riemannian geometry, there may be subRiemannian 
geodesies which arc not the projections of these solutions to Hamilton's equa- 



tions in T*Q. See Ml|, [M2|, me3, [L£]. But 'most' geodesies are obtained as 



projections of these solutions. 

In view of the analogies between Riemannian and subRiemannian geome- 
tries, the question naturally arises: Is geodesic flow on a Carnot group 
always integrable? The answer is "yes" for two step nilpotcnt groups. (The 
flow on the Heisenberg group has been integrated in many places.) The purpose 
of this note is to provide an example of a 3 step Carnot group whose subRieman- 
nian geodesic flow is not algebraically completely integrable. Roughly speaking, 
this means that there is no uniform algebraic description of its "straight lines" . 
We expect nonintegrability to hold for generic r step nilpotent graded groups , 
r > 2. 

In order to proceed we need to describe how the geodesic flow for a Lie group 
can be pushed down to a hamiltonian flow on the dual of its Lie algebra. We 
will also need to recall the deflnition of "complete integrability" . 

In the particular case where the subRiemannian geometry is that of a Carnot 
group G, then the frame Xi for V — Vi can be realized by left-invariant vector 
fields. We may identify the space of left-invariant vector fields with the Lie 
algebra. Thus Xi E G- Then H becomes identified with a fiber-quadratic 
function on the dual G* of the Lie algebra of G. We recall that the dual of any 
Lie-algebra has a Poisson structure, the so-called "Lie-Poisson structure" . This 
can be defined by insisting that 

{Xi,Xj} = — [Xi,Xj] 

where we identify elements Xi of the Lie algebra G with linear functions on its 
dual G* ■ Thus H induces a Hamiltonian vector-field on G* ■ 

Geometrically, what we are doing by studying this Hamiltonian flow on G* 
is studying the 'Poisson reduction' of the subRiemannian geodesic flow on T*G. 
The function H on T*G is left-invariant, and hence so is its subRiemannian 
geodesic flow. The vector fleld defining this flow can then be pushed down to 
the quotient space {T*G)/G of the cotangent bundle by the left G action, thus 
deflning the "Poisson-reduced" flow. Now {T*G)/G = C/* in a natural way 
and when we push down the Hamitonian vector field for H we obtain the one 
discussed in the previous paragraph on G* ■ 
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We recall the definition of completely integrable. A Hamiltonian H (or 
its flow) on a symplectic manifold of dimension 2n is called completely 
INTEGRABLE if wc Can find n functions /i , . . . , /„ which are almost everywhere 
functionally independent {dfi A . . . dfn 7^ 0), which Poisson-commute ({/i, fj} = 
0), and such that H can be expressed as a function of them {H = h{f\, . . . , fn))- 
If the flows of the /; arc complete then their common level sets {/i = ci, . . . /„ = 
Cn] are, for typical constants c^, diffeomorphic to the quotient of i?" by a lattice, 
and on each such level, the flow of H is linear up in the covering space iR". The 
diffeomorphism is provided by action angle coordinate. 

We are interested in whether the subRiemannian geodesic flow on T*G, G 
a Carnot group, is complete integrable. In order to proceed WE will assume 

THAT IF THE FLOW 'UPSTAIRS' ON T*G IS COMPLETELY INTEGRABLE, THEN 

SO IS THE FLOW 'DOWNSTAIRS' ON Q* . The Converse is certainly true: if the 
flow downstairs is integrable then the flow upstairs is integrable. (See the paper 
by Fomenko and Mischenko [FM], or [A].) Our assumption is probably false in 
general, but we expect the exceptions to be 'pathological'. 

We need to say a few words about what we mean by "the flow downstairs 
being integrable" . Any Hamiltonian vector field on Q* is necessarily tangent to 
the orbits of the co-adjoint action of G on Q* . The Poisson structure induces 
a symplectic structure on these orbits, sometimes called the Kirilov-Kostant- 
Souriau structure. When we say that the flow on Q* is 'completely integrable' 
what we mean is that the Hamiltonian flows restricted to typical co-adjoint 
orbits are completely integrable in the sense just described. By a typical orbit 
we mean one whose dimension is maximal, say 2fc. Now 2k = n — r where r 
is the rank of the Lie algebra, which is the dimension of its maximal Abelian 
subalgebra. In any case, complete integrability on the orbit means that there 
are k functionally independent functions /i , . . . , on the typical orbit which 
Poisson-commute with each other and such that H can be expressed in terms of 
them. We assume that these functions vary smoothly with the orbit. The typical 
orbit is defined by the vanishing of r fimctions Ci,...,C,.. These functions 
are Casimirs: they Poisson commute with every function on Q*. Pulled back 
to T*G, and set of r Casimirs forms a a functional basis for the bi-invariant 
functions on T*G. In the nilpotent case it is known that the Casimirs are 
rational functions (see ....). Thus: to say that the reduced system is integrable 
means that H = /i(/i, . . . , /jt; Ci, . . . , Or) for some smooth function h. We say 
it is ALGEBRAICALLY COMPLETELY INTEGRABLE if the fi and h are rational 
functions. 

2 The example 

Take G to be the group of all 4 by 4 lower triangular matrices with I's on the 
diagonal. Its Lie algebra jVL is the space of all strictly lower triangular matrices: 
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/O 0\ 
X I 
u y \' 

\w V z 0/ 

It is generated by the three-dimensional subspace Vi consisting of the subdiag- 
onal matrices: 

/O 0\ 

a; I 

?/ 
Vo z 0/ 

and is coordinatized by x,y,z. The functions x,y, ZjU^VjW are hnear coordi- 
nates on the dual of the Lie algebra, and hence left-invariant fiber linear func- 
tions on T*G. The space V2 = [Vi, Vi] is the uv plane, and V3 = [Vi, V2] is the 
w-axis. For the inner product on Vi we take the standard Euclidean one so that 
X, y,z correspond to the standard orthogonal axex. Thus the subRiemannian 
Hamiltonian is 

H^^{x^+y^ + z^). 

The Poisson structure is the standard Kirillov-Kostant structure defined by 
the formula: 

{F,G}ix)^{x,[dFix),dG{x)]). 

It is well known that this structure is nondegenerate on the orbits of coad- 
joint action. Casimirs, i.e. functions invariant under the coadjoint action, are 
generated by w and uv — yw, see, for example, [Q. 

Theorem 1 The geodesic flow onJ\f-* generated by H is not algebraically com- 
pletely integrable. 

Proof. The Kirillov-Kostant-Souriau Poisson bracket is given by the rela- 
tions: 

{z, u} = w 
{v, x} = w 
{y,x} = u 
{z,y} = V 

with all the other Poisson brackets of the coordinate functions equalling zero. 
We choose x, z, u = ^ and v = ^ a,s Darboux coordinates on generic orbit. 
"Generic" means that w = wq ^ and uv — yw = C 7^ 0. One easily checks 
that and V are independent coordinates on a generic orbit and that 

= 1 
{v,x} 1 
{z, x} — {z, v\ — {x, u\ — {u, v} — 0. 
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In these coordinates Hamiltonian has a form H{x, z, ii, v) = x +z 

, 2 

Under the foUowing hnear symplectic change of coordinates 

X — ^^/wqx 

Z = 

I'l — ^ 



2 1 ^2 I / C-uv 



Wo 

il — ^ 
V — -i . — 



the Hamiltonian becomes (i^ + — 2C^-^ouv + iP'v^ + K), where K is 
some constant depending on wo and C only. This Hamiltonian is proportional 
to a famous Yang-Mills hamiltonian, which Ziglin proved to be rationally non- 



integrable. See Ziglin [Zil|,[Zi2|. □ 



3 Quantization: Extension to the Universal En- 
veloping Algebra 

The non-integrability in rational functions of the system considered above has 
some purely algebraic consequences. 

Lemma 1 Let M- he the algebra ofnilpotent lower triangular Ax A-matrices and 
Pol{J\f-*) be the algebra of polynomials on its dual space N-* . Let {F,H} = 0, 
where H = \{x'^ + + z'^) and F € Pol{N-*). Then F = P{H,w,uv - yw). 
Here x, y, z, u, v, w were defined in the previous section and F is a polynomial. 

Proof. Taking into account the fact that the dimension of the generic orbit 
of the coadjoint representation in A/"-* is 4, we see that if F commuted with H 
but were not of the form P{H,w,uv — yw) then the system defined by H would 
be completely integrable. But this contradicts Theorem 1. □ 

Given any function / in Pol{Af_*) its centralizer with respect to Poisson 
bracket always contains the polynomials F{f,w,uv — yw). For, as mentioned 
earlier, w, uv — yw are the Casimirs for A/L*: they generate the center of 
Pol{N-*). Thus the lemma asserts that the centralizer of H is as small as 
possible. 

We will finish off by proving a similar result for the universal enveloping 
algebra U{N-). U{N-) can be thought of as the algebra of left-invariant dif- 
ferential operators on the Lie group N of upper triangular matrices with I's 
on the diagonal (or on certain homogeneous spaces for N). It is is generated as 
an algebra over R by N- (the 1st order differential operators) and the unit 1 
(the identity operator) . Let Eij be the standard unit matrix with only nonzero 
{i,j) entry equal to 1. Set X = E21, Y = E^2, Z = E^^, U = E31, V = Ei2, 
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W = E41. Then X,Y,Z,U,V,W together with 1 generate U{Af-). Observe 
that this notation is consistent with that used for the elements x, y, z, u, v, w for 
Pol{J\f-*). Thus w is a hnear function on A/"-*, which is to say an element of 
AL. 

Let H = \{X'^ + + Z^) e U{J\f-). It is the "quantization" of our H £ 
Pol{N~*). By a theorem of Hormander, it is a hypoelliptic differential operator 
which is almost as good as being elliptic. It is well-known that the center of 
U{M-) is generated by W and UV — YW. (See Dixmier ||^.) Consequently if R 
is any element of U{N'-) then its commutator algebra contains the subalgebra 
generated by R, W and UV — YW. 

Theorem 2 Any element F in U(Af-) which commutes with H is of the form 
F — P{H, W, UV — YW) for some polynomial P. 

There is no ordering problem in defining the element P{H, W, UV — YW) 
since W and UV — YW commute with everything. The theorem asserts that H 
commutes only with those elements which every operator must commute with. 
It suggests that H, as an operator, should exhibit "quantum chaos" . 

This theorem is a special case of a result which holds for any finite- 
dimensional Lie algebra Q. The result may be well-known to experts but we 
will present it here in any case. 

Let U{Q) be the universal enveloping algebra of the finite-dimensional Lie 
algebra Q and Z{G) C U{G) its center. U{Q) is filtered by degree. An element 
is said to have degree less than or equal to k if it is a sum of monomials of the 
form X1X2 ■ ■ - Xs with the Xi G Q and s < k. li s = k for one of of these 
monomial terms then its degree equals k. The corresponding graded algebra 
Gr{U(G)) is canonically isomorphic to the algebra Pol{Q*) of polynomials on 
Q* . The operator bracket respects the filtration so that it induces a Lie bracket 
on Pol{Q*). This is of course the KKS Poisson-bracket {,-,•} on t/*. 

Let U{G)k denote the subspace of elements of degree k or less. The quotient 
map CTfc : U{G)k U{G)k/U{G)k-i = Pol{G*)k takes elements of degree k to 
homogeneous polynomials of degree k. If an clement F E U{G) has degree k 
then we call <Tk{F) its principal symbol. If two elements in U{G) commute then 
their principal symbols must Poisson-commute in Pol{G)* ■ This follows directly 
from the relation between the operator and Poisson brackets. 

There is a symmetrization map 4> : Pol{G*) U {G) which is a kind of inverse 
to the symbol maps. It is a linear isomorphism but of course not an algebra 
homomorphism. When restricted to the subspace of homogeneous polynomials 
of degree k it satisfies ak o (f) — Id. 

The center Z{G) oi U{G) is finitely generated by elements fi, . . . , fr. These 
elements may be chosen so that their principal symbols fi, . . . , fr generate the 
the center of Pol{G) and so that fi = (j^ifi)- (See Dixmier, or Varadarajan Q, 
Thm. 3.3.8, p. 183.) Elements of either center are called Casimirs. (If G is 
semi-simple then the number r of Casimirs is the rank of the Lie algebra.) 
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Proposition 1 Let H be an element of U{Q) of degree m and H = (pm{H) 
its principal symbol. Suppose that the commutator algebra of H in Pol{Q*) is 

generated by the Casimirs together with H. Then the commutator 

algebra of H in U{Q) is generated by the Casimirs /i, . . . , fm together with H. 

In other words, if the commutator of the principal symbol is as small as 
possible, the same is true for its quantization H. 

Proof. Suppose F commute with H. Let k denote the degree of F and set 
F = (Tk{F). As discussed above, F Poisson-commutes with H. By hypothesis 
F = . . . , fr, H) for some polynomial p. Since the /j are in the center 

of U{G), the element p = p{fi....fr,H) is a well-defined element of U{G), 
independent of the ordering of the factors fi,II. Clearly p commutes with H. 
Moreover ak{p) = F so that ak{F — p) = 0. It follows that F — p = F2 is an 
elcnnent whose degree is A; — 1 or less which commutes with H. 

Repeating this argument with F2 in place of F we obtain a polynomial p2 
in fi, . . . , fr,H and a corresponding element p2 in U{G) such that F — {P + P2) 
commutes with H and has degree A: — 2 or less. Continuing in this fashion we 
eventually descend to degree 0, in which case : 

F =p + P2 + ...+Pk-1 

is a polynomial in the fi,H as claimed. QED 
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